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(54) Multimedia call signalling system and method 



(57) A system and method for performing call sig- 
nalling for multimedia call setups. A user equipped with 
calling terminals of various types may initiate a call from 
any of these terminals, and the call is intercepted and 
handled by the system. A calling agent looks up an E- 
mail address for the called party, and sends a setup re- 
quest E-mail to a called agent associated with the called 
party. The called agent determines the current terminal 



that the callee is using, and together with the calling 
agent a call medium and other parameters are estab- 
lished. Then a connection is made between a calling ter- 
minal and the current terminal. This provides a generic 
signalling system for a callee using a wireline terminal, 
wireless terminal, or H.323 terminal to be connected to 
a called terminal also being any one of these or other 
types. 
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Description 

Field of the Invention 

5 [0001] The invention relates to a system and method for multimedia call signalling. 
Background of the Invention 

[0002] There are many known call setup methods for use in setting up calls within the PSTN (public switched tele- 

10 phone network) though new methods are still evolving. 

[0003] Data telephony, over a data network such as the Internet for example, will likely soon start to carry a significant 
amount of multimedia traffic, and has its own call setup methods for establishing calls over the relevant data network. 
Various different data networks exist including the Internet, wireline networks, cellular networks, and PCS (personal 
communications systems) networks for example. In addition, calls other than voice calls of course are estabiishable 

75 over such data networks. These include FAX calls, video calls, T120 conference calls etc. 

[0004] When a user wants to make a regular phone call, the user's phone informs a switch via a sequence of electrical 
signals, or a message. Software in the switch will engage a process to find out where the called phone is located by 
performing an address translation. The address translation will return the information related to which trunk and which 
protocol should be used to signal a remote CO (captive office) which will ring the called phone. 

20 [0005] In the case of an H.323 terminal, a call setup request is sent in a message to a component called the gate- 
keeper to perform address translation. The address passed to the gatekeeper can be a symbolic name or an Internet 
address. In the current H.323 implementation, the gatekeeper will use the H.245 and H.225 protocols to complete the 

[0006] It would be desirable to be able to place calls of various types from a PSTN based terminal for example for 
25 connection to a data network based terminal, and call setup methods must be established for this. Existing solutions 
have focused on a few particular instances of the problem such as Internet to PSTN voice calls. 
[0007] These existing solutions provide a single solution for one or two media, but do not provide an approach to 
solving the problem in a general fashion. 

[0008] One of the technical challenges in solving this problem is the complexity and diversity of the types of call 
30 processing equipment, call transmission media and protocols involved all of which are based on various technologies. 

Summary of the Invention 

[0009] It is an object of the invention to obviate or mitigate one or more of the above identified disadvantages. 

35 [0010] According to a broad aspect, the invention provides a multimedia call signalling end system comprising a 
calling agent for connection to a network for coordinating the establishment of a connection between a calling terminal 
served by the calling agent and another terminal, the calling agent comprising: a) means for receiving a call setup 
request from the calling terminal including a user identifier; b) means for looking up an E-mail address corresponding 
with the user identifier; c) means for generating a call setup E-mail with said E-mail address and mailing it to said 

40 address; and d) first means for coordinating the establishment of an outgoing connection between the calling terminal 
and the another terminal. 

[001 1] A first element empowering this invention is based on an encapsulation principle. Because different telephony 
and communication networks use different signalling protocols, to make the signalling protocol independent the call 
setup requests are encapsulated in a common format. This invention devises a scheme to encapsulate an outgoing 
45 call request with all associated attributes preferably using the MIME (Multipurpose Internet Mail Extension) principle 
from Internet Engineering Task Force (IETF). 

[0012] A second element empowering this invention is the use of an E-mail address or an electronic address for the 
user. Once used, this conceals the discrepancies or deficiencies of the terminals to be connected and broadens the 
choice of the medium which can be used for the connection. 
so [001 3] A third preferred element empowering this invention is the use of MIME application typing so that an electronic 
message server can associate any required processing with various components in the message. As a result, this 
invention provides a generic mechanism to support multi-media multichannel and multi-device communication call 
setup. 

[0014] The broad application domain of the signalling protocol allows it to be applied to PSTN, Internet and cable 
ss networks and to other network types as it becomes appropriate. It also enables the establishment of multi-media phone 
calls that support multiple terminals and connections. 

[001 5] Advantageously, the system provided by some embodiments of the invention is applicable to existing teleph- 
ony equipment without the need for any change to customer equipment. 
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Rripf Qpscriotion of the Drawings 

[0016] Preferred embodiments of the invention will now be described with reference to the attached drawings in 
which: 

Figure 1 is a logical block diagram of a terminal as it would be viewed by a multimedia call signalling system 
according to an embodiment of the invention; m ^„. ir ^- 
Figure 2 is an abstract model of a multimedia call signalling system accord.ng to an embod.ment of the .nvent,on, 
Figure 3 is an example call setup walkthrough; 

Fioure 4 is an abstract model of the system of Figure 2 including a remote configuration, 
Fioures 5a - 5d are state diagrams for a Calling Agent, calling process. Called Agent and called process; and 
Figures 6 - 12 are signal flow diagrams for further examples of call setup functions and telephony services. 

Detailed Description of the Prefe rred Embodiments 

100171 F.qure 1 is a logical block diagram which includes basically all the user interlace and functional blocks that 
Lh< be accessible to a particular user. It is intended to be a somewhat comprehensive view ol all the ways a user 
Jtt be capable ot communicating. In reality, a particular user would typically have access only to a subset of the 
Jctonahtymustrated in Figurel.The user equipment is generally indicated by 5. and the network .s genera^ 
20 by 7 The use. equipmen. 5 includes various user interface components generally .nd.cated by 10 such as a camera/ 
L.ne. 1 1 d, S play 1 2. keypad 1 4, buttons and indicators 1 6. media player 18. and media recorder 20. These are each 
c^ctcd to one or more service app.icatrcns generally indicated by 22 which include a video serv.ee 24, a fax sennce 
r^web scrv.ee 23. and a voice service 30. Each of the service applications 22 has access to the user interface 
components 1 0 as requ.red. The voice service 30 is also interfaced with a voice-activated services serv.ee application 

" 10018] Each o. the serv.ee applications 22 is interfaced to the network 7 through a respective medium protocol gen- 
o^lly nd.cated by 38 Tne network 7 may include a number of different network types, such as a PSTN (pubhc switched 
S„t netwJk, 34. a cable network 35, and the Internet 36. The medium protocols 38 include video 40, fax 42£ 
12 0 ron.orenc.ng 44 H 323 46. wireless/wireline telephony 47. HTTP (hyper-texl transport protocol) 48 an IMAP 
\Lw Mail Access Protocol) 52. The interfaces befween the network 7 and the terminal 5 are genera ty indicated 
by 53 and include a transport layer protocol 54 and a physical layer protocol 55. The transport layer protocol 54 provides 
an apphcation independent transport mechanism. Figure 1 has been simplified to collapse the ISO's Session Layer 
Nelwo r^Layer Transport Layer and Link Layer to just the Transport Layer. While Figure 1 is intended to be ^morec* 
"ess comprehensive regarding what capabilities a user's equipment might possess, tt .s to be understood that a user 
may ndeed have additional £u*ment for interfacing with the PSTN, cab.e. the Internet, or some other netwo^and 
™s elpment may be used in the contexl of the invention as well. The equipment of F.gure 1 may reside on a number 
of different terminals such as a videoterminal. a fax machine, a WWW connected computer, a wireline termmal, w.reless 

Z7e1^el H eTJ^e 1 is a logical one, soactual components would likely be P^^^J^^ 
foVl91 An abstract view of a multimedia call signalling system (MCSS) according to an embodiment of he invention 
s shown in Figure 2. Whenever any connection is to be made there will always be a caller having a calling terminal 
and a cal.ee having a called terminal. In Figure 2, the caller's user equipment (5 in Figure 1 ) ,s 0""^*^ * 
100 and includes various types of terminal including a wireline terminal 102, a wireless terminal 104, and an H.323 
termS 06 The communications network is again generally indicated by 7. The network 7 includes an outgoing 
MCSS end system 80 and an incoming MCSS end system 82. The outgoing MCSS end system 80 ,s he , port™ of 
the MCSS involved with hand.ing an outgoing call, and this cooperates with the incoming MCSS end *^ <£* 
s the portion of the MCSS which hand.es an incoming call request. In the examp.e of F.gure 2. there are two MCSS 
end systems 80,82, the outgoing MCSS end system handling outgoing call requests, and the mcom.ng MCSS end 
svstem handling incoming call requests received from the first MCSS end system. A completely equ.pped MCSS end 
sys em wouki be equipped to handle both incoming call requests from other end systems and outgoing caH quests 
to other end systems, and thus to fulfil the roles of both an outgoing MCSS end system and an ,ncom,ng MCSS end 
svstem A connection which is established by such an MCSS end system while acting upon an outgoing call request 
mav be referred to as an outgoing connection, and a connection which is established by such an MCSS end system 
wht acTg on an incoming call request may be referred to as an incoming connection. In this abstrad view th.s 
ss network includes various subnetworks required to provide communications links to the caller's term.nals These are 
idSed further below. Each of the caller's terminals 102.104.106 are connected the re.evant port,on of the ne work 
througha respective terminal network interface 108.110,112. The H.323 terminal 106 may be connected to the network 
7 through a dial-up link using Point to Point Protocol (PPP) via a modem, directly connected to the network over 
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Ethernet, connected through IP over ATM or IP over cable modem. The terminal network interlace 108 for the wireline 
terminal 102 will be a twisted pair connecting the terminal to a captive office or a public branch exchange (PBX). For 
the wireless terminal 104, the terminal network interface 110 will be the wireless link which connects the wireless 
terminal to a ground station. 

5 [0020] The MCSS is implemented in large part by a class of entities which will be referred to herein as Call Setup 
Agents. There are three types of Call Setup agents which are used, and these will be referred to as Calling Agents, 
Called Agents, and Call Agents. An outgoing call is handled by a Calling Agent 114, and an incoming call is handled 
by a Called Agent 116. Each MCSS end system 80 ? 82 has a respective Call Agent 115,117 which acts as an interface 
to the MCSS from telephone company OA&M systems 123,125 and from users through respective user interlaces 

to 1 19,121 . Each of these agents are described in detail below. For the purpose of this example, it is assumed that the 
Calling Agent 114 spawns a Calling Process 187 to handle each outgoing call and that the Called Agent 116 spawns 
a Called Process 189 to handle each incoming call. 

[0021] The terminal network interfaces 108,110,112 for calling terminals 102,104,106 are connected to the Calling 
Agent 114 through respective local network interfaces 109,111,113 and a calling presentation driver 120. 

is [0022] The presentation driver 1 20 is responsible for exchanging data between the Calling Agent 11 4 and an appro- 
priate one of the local network interlaces 109,111,113 (and subsequently with the appropriate terminal). 
[0023] Each of the local network interfaces 109,111,113 may be considered a CIP (call intercept point), or a point 
where call signalling is intercepted and diverted from its conventional flow and converted to signals according to the 
MCSS provided by this embodiment of the invention. The local network interfaces have physical layer protocols which 

20 provide the physical interfaces to the network. Some examples include Ethernet, Point to Point Protocol, SLIP protocol, 
ATM, Frame Relay, analog signalling for POTS, ISDN Basic Rate Interface physical layer, TV Cable, and CDMA for 
Wireless Networks. 

[0024] The calling presentation driver 1 20 has access to a terminal profile database 1 22 which contains information 
on the user's terminals 102,104,106 and to a user profile database 124 which contains information on the user per se. 
25 The terminal profile for a selected one of terminals 102,104,106 is consulted by the presentation driver 120 to decide 
what type of conversion is required if any, in passing data to and from the selected one of the subscriber terminals 
102,104,106. 

[0025] The callee's user equipment (5 in Figure 1 ) is generally indicated by 1 30 and is basically identical to the caller's 
user equipment 100. Again there are three terminals 132,134,136 connected through respective terminal network 

30 interfaces 138,140,142, to the incoming MCSS end system 82 through a respective local network interface 
139.141.143, a called presentation driver 146 and the previously identified Called Agent 116. 
[0026] The called presentation driver 146 for the Called Agent 116 has access to a terminal profile database 148 
which contains information on the called user's terminals; and has access to a user profile database 1 50. The terminal 
profile database 148 will be consulted for a terminal profile for a selected one of terminals 132,134,136 to decide what 

35 type of conversion if any is required in passing data to and from the selected terminal during call setup. 

[0027] The presentatbn drivers 1 20, 1 46 are also responsible for the presentation and routing of the call to the callee's 
current terminal which may be on a different calling medium that the calling terminal. This is a function of signalling 
the callee's current terminal using the appropriate local network interlace depending on the current terminal of the user. 
The choice of terminal is not made by the presentation driver. Rather, it is made by the Called Agent 116. The pres- 

40 entation drivers 120,1 46, must execute any required signalling conversions from one calling medium to another. 

[0028] The presentation drivers use the terminal profile to decide what kind of conversion is needed. When a call is 
established, there are one or more connections (call streams). Each stream carries one type of data, for example voice, 
video, graphic, or data. The presentation drivers will convert data and route it to the appropriate local network interface. 
For example, a POTS-to-POTS call will always route through a line card. For video signals from a video-on-demand 

45 call, the data will be routed to a co-axial cable. As discussed below, during call setup negotiation, a medium for use in 
establishing a connection is determined. The medium will require a particular transmission protocol which may differ 
from that expected or generated by either or both of the calling terminal and the user's current terminal. The calling 
presentation driver 120 must perform a receive type conversion on signals received over the connection from the 
transmission protocol to the calling terminal's native signalling protocol if these protocols differ, and must similarly 

so perform a transmit type conversion on signals to be transmitted over the connection from the calling terminal's native 
signalling protocol to the transmission protocol if these protocols differ. Similarly the called presentation driver 146 
must perform a receive type conversion on signals received over the connection from the transmission protocol to the 
callee's current terminaPs native signalling protocol if these protocols differ, and must perform a transmit type conversion 
on signals to be transmitted over the connection from the current terminal's native signalling protocol to the transmission 

55 protocol if these protocols differ. 

[0029] The presentation driver may, for example, perform codec conversion to convert between different codecs 
used by two different terminals. For example, one end of the call may be a POTS terminal, the codec used is 64KPCM 
(64 Kilobit Pulse Code Modulation) in order to drive a PSTN line card while the other end may be an H.323 terminal 
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that uses a G.723. 1 codec In this case the presentation driver has to convert the G.723. 1 codec to the 64KPCM voice 
data format to deliver any voice attachment associated with the call setup. 

SSJTSL graphic oata is exchanged, the terminal may not be ab.e to support a certarn format of graph.cs , 
soVhe calling/Called Agent will instruct the respective presentation drrver to convert to the appropnate format. A fax 
Sana! ifa form of graphic format. The fax machine is a terminal which may not support a specie type of encod.ng. 
The presentation driver may have to convert it to an encoding method acceptable go the fax mach.ne. 

in some case, a JPEG picture may be sent to a fax machine, and in this case the presentation dnver may be 
configured to convert the data to a format accepted by the fax machine. 

S] Video has many different formats. Most of the time a terminal would have vanous drfferent software capable 
Edie vSus video formats. In some stations the ,enr,ina. wi.l no. accept certain video formats. ^ 
Ts needed when no capable software is available. For example a terminal might only be able to play MPEG 1 Mot on 
Pcture Expert ^ Group standard) video in a situatbn where only MPEG 4 video is sent. Rather than reject the caM the 
customer has subscribed to the conversion feature, the presentation driver can perform the conversion from MPEG 4 

lMMl EG Video conversion is also needed when no compatible hardware is available. For example, when an MPEG 
video is requested to be send out to a TV via cable, the data signal is not compatible. The presentat.on dnver may be 
confiaured to convert from the MPEG video to the cable signal. 

ESSa third video conversion scenario invokes rate adaptation. If the link in 28.3 K baud, and the encoded data 
ate tor a video stream broadcast is 56 K baud, the presentation driver will convert the signal format suitable for 56 K 
data rate is 28 8 data rale. Sometimes this conversion may require a formal change, e.g. from MPEG to VxTreme. 
iSf Te* may have to be converted from one encoding scheme to another. For example, ASCI. (American Standard 
Sir SrSon interchange) text may be converted to ISO Unicode and vice versa. For a term.nal. whx* has 
no display, the text data can be converted to speech. 

££q Referring again to Figure 2, each of the Calling Agent ,14 and Called Agent 116 are 
carrie network 170 forming part of network 7 through a respecth/e telephony signalling componen 172,174. S milarly 
h are each connected to a PSN (packet switching network) carrier network 178 forming part of networ through 
a respective e.ectronic messaging interface 180.182 (or E-mail server) and through a respect.ve Internet telephony 
siSfno components 181 ,183. The electronic messaging interfaces 180,182 are preferabfy ma.l servers and will be 
XSoTsSh in what follows, and more preferably are MIME E-mail servers. The PSTN earner network 170 , and 
the PSN carrier network 178 may be connected to each other through a bridge 184. The PSN earner network 178 .s 
anu tra ditional Data Network and, for example might be ATM, Internet or Frame Relay. 

SKT^n^n*. 180,182 are used to send E-mail from the Calling Agent 114 to the Called Agent 116. They 
alsoassumethe responsibility of delivering reply mail from the Called Agent 11 6 to the Calling Agent 114. These servers 
prSerabV have the functionally of conventional mail servers in addition to some extra processmg f unc ,ons for real zing 
me MCSS When the Calling/Called Agent 114,116 starts up, it will register with the respective ma,l server 180. 82. 
When one oithe mail servers 180.182 receives an E-mal. i. will strip the header and pass the contents to the Call.ng 

w"V££^"i"e preferably take advantage of a conventional mail server's features which delude: 

40 1 . Address resolution; 

2 Universal support around different networks; 

3. Store and forward technology that can provide a reasonably safe delivery transport layer, 

4. Message storage server which manages the messages; 

5. Provides notification service from the network; and 
45 6. Wide support to access the contents. 

f00391 Preferabfy the mail servers 180,182 use the MIME (Multipurpose Internet Mail Extension) format, and this will 
be assumed in what follows. It is to be understood that while MIME encoding is the most convenient presently known 
mechanism for formatting the information to be included in the various electronic messages other encodng and I for- 
mal echn*^^^ may be used, as appropriate. It is further to be understood that the mail 

ZLed by any reliable electronic message transport mechanism which provdes the same or s,m.lar f unc .on. For 
LTamp'e each mail account cou!d be replaced by a URL (universe, resource focator) in which ^case the electron* 
merges would be delivered to the Called Agent on a web server of the designated URL embedded ,n a web page^ 
As aether example, a direct TCP/IP connection could be used to transfer the message between the Ca mg , Agent 
and tS Called Agent. In this case, the e.ectronic address of the Calling Agent would be a combmat.on of a TCP/IP 
address and a service port number of the TCP/IP connection. 

rrSj ^ The PSTN signalling components 172,174 handle the PSTN telephony protocols such as ISDN Pr^ary Rate, 
ISDN basic rate or Common Channel Signalling Number 7. Other per trunk signalling ,s also supported by these com- 
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ponents "" K eir main function is to complete a PSTN call connection at the last phase of a call setup. The PSTN signalling 
compon- ; 172,174 are different from the PSTN local network interfaces 109,111. The PSTN local network interfaces 
109,111 if lercept calls from the wireline, wireless terminals 102,104 and pass them to the presentation driver 120. 
whereas the telephony signalling components 172,174 are involved with the actual connection of a call after it has 

s been intercepted, and a decision has been made to connect it over the PSTN carrier network 170. 

[0041] The Internet signalling components 181 ,183 handle Internet call connection at the last phase of a call setup. 
These are usually H.323 Gatekeepers. This Gatekeeper is different from the Call Interception Point Gatekeeper which 
exists in the iocal network interface 11 3 for the H.323 terminal 106. The Gatekeeper in the local network interface 113 
intercepts call requests from the H.323 terminal and passes them to the Presentation driver 120, whereas the Gate- 

10 keeper in the Internet signalling components 181,183 are involved with the actual connection of a call after it has been 
intercepted and a decision has been made to connect it over the PSN carrier network 178. 

[0042] The bridge 184 links the PSTN 170 and PSN 178 together. It is usually called the Voice over IP Gateway. 
This gateway provides three major functions: 

15 1. Signalling conversion - During the call setup phase, the call setup signalling protocol from one type of network 

is converted to another. 

2. Directory services - The directory system for the PSTN and PSN does not have to be the same. It the PSN is 
ATM or X.25 it can be using the E.164 numbering scheme, and there is still the requirement to do a conversion 
bciween the letter, region and captive office. 
20 3 voice transcoding - The codec for the Wireline is 64KPCM, the coded for Wireless can be a different type of 

CELPS (code excited linear prediction) and the Internet can be G.721 or G.723. In order to relay the voice signal 
between the PSN and PSTN, the codec has to be changed form one format to another. 

[0043] Each of the Calling Agent 114 and the Called Agent 116 are also connected to a respective address database 
25 1=6 1 89 containing a translation between user identifiers and corresponding E-mail addresses as described in detail 
bolow Whilo shown as two logical entities, the address databases 186,188 may consist of one or more actual data- 
bases Furthermore, the E-mail addresses may be replaced by any electronic address used by an appropriate message 
deliver transport mechanism. 

[0044] The Calling Agent 1 1 4 and the Called Agent 1 1 6 are software entities each associated with (logically connected 
30 to) mail servers 1 80. 1 82 They are activated to process the E-mail messages when these are received by the associated 
mail server. The mechanism which the mail servers use to trigger the activation of the Calling and Called Agents 
114.116 is an application class identified in the application class tag forming part of the E-mail message body in MIME 
format defined by this embodiment of the invention. 

[0045] The Calling Agent 114 is the entity which handles outgoing calls. The main functions of the Calling Agent 14 
35 is to: 

1 . perform an E-mail address resolution from the called number or Internet address (fully resolved address or alias) 
requested by the caller; 

2. create a unique reference identification for each outgoing call; 
40 3. construct an E-mail to be sent to the Called Agent 116; 

4. process the negotiation of call setup parameters; and 

5. participate in the initiation of the establishment of the real call connection after the callee terminal address and 
the call medium is received and settled through the negotiation process. 

45 [0046] It should be noted that through the address resolution using the information from the address database 186, 
the call can be setup on behalf of other devices rather than for the terminal from which the user initiated the request. 
This type of request would be constructed through an appropriate user interface 119. For example, a user can use the 
system lo set up a call between the cable company and his/her cable reception box for a movie on demand. The Calling 
Agent 114 will recognize the type of call, movie on demand and engage in a dialog to prompt for more information on 

50 what movie is requested. The Calling Agent 114 will include the information in a mail message as part of a call data 
parameter using a CALLJDATA option and will send the message to the cable company's Called Agent. When the 
cable company's Called Agent 116 receives the request, it can reply with an acceptance mail and initiate the down- 
loading of the movie either through multicast or by injecting the video to the cable co-axial circuit connected to the user. 
[0047] Every customer will have a Calling Agent 11 4 to perform the outgoing call function. The actual implementation 

55 can be done by a process, a thread or a single process action on data structures which represent the Calling Agent 
114. Because the Calling Agent 114 is not necessarily active 100% of the time, and may be event driven, it is more 
complicated to implement the Calling Agent other than by using the separate process or thread technique. 
[0048] Figure 5a is a state diagram for the Calling Agent 114. Each user has one Calling Agent 114 to handle the 
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outgoing call. Once it is started, it may create Cones of itsell to handle multiple calls from one or different ermjnate 
,2 the same user. In this example, it is assumed that the Calling Agent 114 spawns a Calling Process 1 87 to handle 
each call. The state transitions tor the Calling Agent 114 are defined in the tallowing table: 





Transition Condition 


New State 


Start 


Succeed on initialization and register with the Signalling Components using the 
user's account 


Idle 


Idle 


When a call request is received 


Spawn 


Spawn 


Successfully spawn a calling process to process the call 


Idle 


Spawn 


Failed to spawn a calling process 


Spawn Failed 


Spawn Failed 


Send reject request to the user 


Idle 


Idle 


Received Reply 


Update 


Update 


Relayed the information to the Calling Process 


Idle 



TO 



IS 
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State descriptions: 
[0049] 



State 


Description 


Idle 


Initial state 


Spawn 


Spawn a Calling Process 


Spawn Failed 


Recover after the spawn failed 


Update 


Relay the call related information to the Calling Process 



100501 The Calling Process 187 is an execution thread or a process to handle the outgoing call. Its mam design 
SecL is to allow multiple calls to be performed simultaneously so as to handle multiple call streams tonne. 
Stole lerminals. II multiple calls are initialed from the same terminal at the same lime, only on. .Calling Process is 
T o because the processing is still sequential. However in the actual detailed implementation, each can tor-n. 
terminal in a multiple call request can be handled by one of multiple threads or by sub^rocesses ot the Calling Process 
o sTm My the processing. Each thread or sub-process is associated with the Calling Process usmg the call reference 
speSn each ca.l specification in the mail message. The Calling Process does not interface with the mail servers 
directly Rather it constructs the MIME message and requests the Calling Agent to initiate the delivery of the message. 
Using this design allows the Calling Process to be independent of the message deliver transport mechanism. The 
states and transitions of the Calling Process are illustrated in Figure 5b. 
[0051] The state transitions for the Calling Process are defined in the following table: 



Initial State 


Transition Condition 


New State 


Start 


Upon receiving the call request from the Calling Agent 


Address Resolution 


Address Resolution 


Successfully maps the Directory Number or IP address/alias to an E- 
mail address 


Call Init 


Address Resolution 


Failed to map the Directory Number or IP to an E-mail address 


Reject Request 


Call Init 


Successfully construct the MIME message and send the E-mail 


Confirm Pending 


Call I nit 


Failed to construct the MIME or failed to send the E-mail 


Reject Request 


Confirm Pending 


Receives a call progress reply 


Call Progress 


Call Progress 


Inform the user on call progress 


Confirm Pending 


Confirm Pending 


Receive negotiation reply 


Negotiation 


Negotiation 


Send negotiation reply 


Confirm Pending 
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(continued) 



Initial State 


Transition Condition 


iww oiaie 


Negotiation 


Failed to send the reply 


Reject Request 


Confirm Pending 


Receive call accept reply 


Initiate Connect 


Confirm Pending 


Receive disconnect reply 


Reject Request 


Initiate Connect 


Initiate the call connection with success 


oau oompieie 


Call Complete 


Inform the Calling Agent on the completion status 


oian 


Initiate Connect 


EoNa/H tr\ octaHlich thf> rail iiQinn P^TNI «;innallma or Internet sionallina 

r 3 II GO lO G old DM of 1 lllc Call Uoll iy i O 1 IN oiy I idiiti iy y-fi m i ici i ic l oiyiicjiuiiy 


Reject Request 


All States 


Receive disconnect reply 


Start 


Confirm Pending 


Receive connect abort request from the Calling Agent 


Abort 


Initiate Connect 


Receive connect abort request from the Calling Agent 


Abort 


Abort 


Send disconnect request to Called Agent 


Start 


Reject 


inlorm user that the call 


Start i 


Request 


request is rejected and clean up 





[0052] The Called Agent 1 1 6 processes the incoming call request in the mail message. It is activated by the associated 
mail server 182 when an E-mail is received. The application class tag in the E-mail is selected so as to be associated 
with the Called Agent software. In conventional mail systems when the mail server receives an E-mail, a user is notified. 
In this case however it is the Called Agent 116 which is informed. The Called Agent 116 may be implemented as mail 
client software. Every customer will have a Called Agent 116 waiting for any incoming call. Once the mail server 182 
receives the incoming mail for the Called Agent 116, the Called Agent is notified and the E-mail is passed to the Called 
Agent which will extract the call information. 

[0053] The implementation of the Called Agent 116 should support call parallelism. In a PSTN world, users usually 
need to setup one call from one to another But with multi-media, multiple calls may be needed to support audio, video, 
text messaging, fax transfer or file transfer from one user to another users simultaneously. Therefore, parallelism is 
vital to the success of a multi-media telephony system. The implementation of the Called Agent 116 will be parallel to 
the above described implementation of the Calling Agent 114. It spawns a Called Process 189 to process the call 
request. This will simplify the design of the Called Agent 116. 

[0054] The functions of the Called Agent 116 extracting the call setup request information from received mail mes- 
sages, spawning a Called Process 189 to execute the call setup request, and extract the call setup reply information 
and pass this to the Called Process. A state diagram for a Called Agent 116 is shown in Figure 5c. The state transitions 
for the Called Agent 116 are defined in the following table: 



State 


Transition Condition 


New State 


Start 


Complete Initialization 


Idle 


Idle 


Call request received 


Spawn 


Spawn 


Created a Called Process successfully 


Idle 


Spawn 


Failed to create a Called Process 


Spawn Fail 


Spawn Fail 


Reported error 


Idle 


Idle 


Received Reply 


Update 


Update 


Inform Called Process 


Idle 



[0055] A Called Process 189 is an execution thread or a process which will serve the call setup. It does not interface 
with the mail server. Rather it gets information from the Called Agent. Therefore, the Called Process can work with 
55 other mechanisms which deliver the call setup request and call reply messages in MIME format. 

[0056] The Called Process uses the User Profile Database 1 88 to find the current terminal which the callee is working 
on. If the current terminal can terminate the call, the Called Process can construct a reply mail message to accept the 
call. 
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[0057] It can also use information in the User Profile to perform call filtering, for example, to reject calls froi 
particular user or to only accept calls from a list of explicitly specified people. 

[0058] A state diagram for a Called Process is shown in Figure 5d. The state transitions for a Called Process 
defined in the following table: 



oiaie 


Transition Condition 


New State 


Start 


Received the call setup request 


Activaled 


Activated 


User profile requires call hand over to Call Management 


uaii Management 


Activated 


User profile requires call hand over to Personal Agent 


Personal Agent 


Call Management 


Call is accepted but requires negotiation 


Accept | 


Call Management 


All information is received, 

Call can be presented to the user. 


Present 


Call Management 


Call is rejected. 


Reject 


Call Management 


Call is completed and no more call setup is needed 


Complete 


Personal Agent 


Call is accepted 


Accept 


Personal Agent 


All information is received. 

Pall ran hp nrp<5PntPri to the USer 


Present 


Personal Agent 


Pall ie roio^toH 
Oall lb loJtJUlcU. 


Reject 


Personal Agent 


Pall i«: rnmnlpted and no more call setup needed 


Complete 


Activated 


Pall ic ar*r*pntpri 


Accept 


Activated 


Alt information is received 

Call can be presented to the user 


Present 


Activated 


Call is rejected 


Reject 


Activated 


Call is complete and no more call setup is needed 


Complete 


Accept 


Require parameter negotiation 


Negotiate 


Negotiate 


Receive a negotiate reply 


Negotiate 


Negotiate 


Parameter match 


Present 


Present 


Successfully offered to the terminal 


Alert 


Present 


Failed to offer the call 


Reject 


Alert 


Send Alert call progress reply to Calling Agent 


Complete 


Alert 


Connection timed out and call forward option is available 


Forward 


Forward 


Send Forward call progress reply and forward the mail message 


Exit 


Reject 


Send Reject call progress reply to Calling Agent 


Exit 


Disconnect 


Send clean up message 


Exit 


Complete 


Send Disconnect reply to Calling Agent 


Exit 


All Slates 


Upon receiving a Disconnect from the Caller 


Exit 


All States 


Upon received an abort request 


Abort 


Abort 


Send Disconnect to Caller 


Exit 



[0059] The states in the Called Process state transition diagram of Figure 5d are described in the following table: 



State 


Description 


Start 


Initial state of the process 
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(continued) 



State 


Description 


Active 


The beginning state of handling the call 


Call Management 


When the call is handed off to the Call Management System, the Called Process remains in 
this state until the call is returned from the Call Management System 


Personal Agent 


When the call is handed off to the Personal Agent System, the Called. Process remains in this 
state until the call is returned from the Personal Agent System 


Accept 


The call can be processed to either be presented to the caller or for negotiation 


Negotiate 


The call enters the parameter negotiation process 


Present 


The call is presented to the caller's terminal 


Alert 


-r. . . „ ■ ,_■ - ^-jh tko noii^r! Drnrocc hac ininrmpri the Called Aoent that the caller s 
The terminal is ringing ana me uaneo rrocess na& iniuimeu u ie *~»y c| » » ,ai ,w 

terminal is ringing 


Forward 


The call is forwarded to another Called Agent 


Reject 


The call is rejected due to various reasons 


Disconnect 


The call will not be connected. The Calling Agent will be instructed to disconnect the call 


Complete 


The call has been established 


Abort 


The call has to be abruptly terminated 
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[0060] In the description which follows, the distinction between the Calling Agent and the Calling Processes which 
it spawns is largely ignored for the sake of simplicity, and a similar simplification is made for the Called Agent and the 
Called Processes. . ^ 

[00611 The Call Agents 11 5,11 7 are the entities which handles interactions and interfaces with the address database, 
terminal profile and user profile. They also handles the management of the Calling Agent and the Called Agent. User 
or Telephony OA&M systems interact with the Call Agent to maintain the profiles. The following are the functions of 
the Call Agent: 

1. interface with the Telephony company's Operation, Administration, Maintenance and Provisioning system 
(OAM&P) to configure and maintain the user profile and terminal profile; 

2. Collect calling detail records (CDR), operation measurements (OM) and logs from the Calling Agent and Called 
Agent; 

3. Provide the CDR, OM and logs to the Telephone company's OA&M system; 

4. Accept change of terminal request from the user and update the user profile; 

5 Responsible tor the startup and restart of the user's Calling Agent and Called Agent; and 

6 Access the mail account for the user to retrieve call information. If the user would like to review how many call 
have been received today, the number of call setup request E-mails can be retrieved and presented to the user. 
These E-mail records are like caller ID records on a Caller ID Display device. 

ADDRESS DATABASE 

[0062] A major principle used by this invention is address translation which may be implemented as a form of directory 
look-up This invention introduces new procedures into the address translation process used by the CO and the Gate- 
keeper and rather than using the native signalling protocol to complete the phone call, an additional layer of signalling 
protocol is introduced to allow the far end to handle the call indifferently for a wireline, wireless, and Internet phone. 
This new protocol does not replace the conventional telephony protocol but adds an additional layer to provide proper 
coupling between different telephone networks. More particularly, call setup signalling is performed through E-mail 
communication between the Calling Agent 114 and the Called Agent 116. Once the type and medium for the call have 
been established, the conventional telephony signalling components 172,174 and/or in the Internet signalling compo- 
nents 1 81 , 1 83 are used to complete the connection. 

[0063] For a given user, there will be one or more user identifiers. Each user has a one or more separate user 
identifiers for each type of network identifier for which the user has terminals. For example, if the user has a wireline 
terminal and a wireless terminal, both of these terminals will have an E.164 type network identifier, and can together 
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an E.164 terminal address. .rfpntifier there will be an identification ol the types ol 

,0064] in addition to this translate ,n ormation, ^^T^^^, capability of the terminals. If 
call media supported by the assorted ^^J^^^X^ *» destination terminals, this can be 
a call setup request is received demanding a quality beyond J" cqpmmy o ^ 

directory services for example, depending upon the design of the network. 
TERMINAL PROFILE 

St?:! type "eenbee Ibe type - ,.m«l. It can be a wwleea - H323 «M 

S^;*.;" StSS^SSSSS MM TNt »*» 3 use, ,o 

USER PROFILE 

design* by" provide, ol me MCSS; himelllhe.eell to Ibe 

provider; 
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Subscribed Services - This describes non-terminal related services to which the user has subscribed. This entry 
contains information on what services are subscribed to on every terminal using the MCSS. Examples are a per- 
sonal agent service which permits call filtering or screening, and unified messaging which provides access to a 
mail server; 

s Current Terminal - This points to the current terminal associated with the user The current terminal is only allowed 

to be one of the predefined set of terminals for which terminal profiles exist or can be created dynamically; 
Current Call Management - This points to a current call management description. Call management features are 
oflered by the existing telephone company such as a list of terminal numbers which can be activated by name 
dialling, customized announcements for specific calling IDs, offering calling information to the user with the option 

10 to reject the call, answer with a recorded message, or return a busy signal; 

Quality of Service - This determines the grade of service subscribed to by the user. The user can request automatic 
PSTN to Voice Over IP gateway for long distance using a specific codec, for example. Some codecs require less 
bandwidth which can be more adaptive to Internet delay. The quality of service may also be used to determine 
how a terminal call is to be routed. For example, when a call is originated from the PSTN for connection to H.323, 

J 5 this option can be used to determine whether a near end gateway or a far end gateway is used. Near end gateway 

will be cheaper but subject to Internet delay. For end gateway will be higher quality but may result in the requirement 
of paying distance charges. 

[0069] Alternatively, a call may be setup over an ATM network in a private data network rather than over the global 
20 Internet; 

Personal agent service - This points to any implementation of a personal agent to which the user has subscribed 
or has access. When a call setup request is received, the request can involve the personal agent implementation 
to perform advanced functions such as filtering; 
25 Call Forward Address - This stores a call forward address. This may be a terminal address of a terminal not 

belonging to the user to which the presentation driver may deliver a call, or a new E-mail address of another Called 
Agent. 

CALL SETUP REQUEST 

30 

[0070] The first step in setting up any call is a call origination from a calling terminal. This will result in a call setup 
request in the protocol of the native network of the particular calling terminal. This may be a conventional call setup 
request which is the same whether or not the MCSS provided by this embodiment of the invention is used. The call 
setup request is intercepted at the call intercept point, this being the local network interface for the particular calling 
35 terminal. The setup request is then passed through the relevant local network interface and the calling presentation 
driver 120 to the Calling Agent 114. The setup request includes a called user identifier for the called party. Alternatively, 
the call setup request may be generated trough the user interface 19 which permits a more generalized call setup 
request to be made. 

[0071] As described below, the called user identifier is translated by the Called Agent 11 6 to a terminal identifier for 
^0 whichever of the user's terminals is the active or presently selected. 

E-mail MESSAGE STRUCTURE AND CONTENTS 

[0072] Call setup and call reply E-mail messages are used to perform call setup signalling according to this embod- 
45 iment of the invention. A call setup message is generated once by the Calling Agent to activate call setup activities. 
Thereafter, call reply messages are used for the remaining lifetime of the call setup and may be generated by both the 
Calling Agent and the Called Agent. Each component of a message is referred to as a parameter, and a parameter 
may itself contain parameters. In the following, the contents of the messages are described hierarchically. Messaging 
is preferably done using the RFC 1341, 1342, 1522 and 1531 MIME (Multipurpose Internet Mail Extensions) format. 
so The following message formats are defined using BNF's (Backus Naur Forms) but this may not necessarily be the case. 

MIME Signalling Message BNF 

[0073] This is the generic form of any message being used for the MCSS, and applies for both call setup and call 
ss reply messages: 

<mime-signalling>::=<call-setup>l<call-reply> 
In the above, the symbol T means that one of the two components it separates is included in the message, i.e. either 
the <call-setup> component or the <call-reply> component. 
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CALL SETUP E-mail MESSAGE 

r0074] In response to a call setup request, the Calling Agent 11 4 constructs a call setup E-mail message addressed 
to the E-mail address associated with the called user identifier This involves filling in the <call-setup> field of the above 
described generic call signalling E-mail message as follows: 

<call-setup>: :=<mime-header><callinfo><callinfo>*<mime-data>* 
<mime-header> : : = "MIME-Version : 1 . 0 " CRLF 

<callinfo> : : =<call info-header ><callinfo-body><options>* 

<attachment> T <callinf o-end> 
<callinfo-header>: : ="application/x-call • ; <boundary- 

specif ication> 

<callinfo-body> : : =<cal ler>CRLF<called>CRLF <cal 1 -medium>CRLF 

<call-ref>CRLF<call-action>CRLF<quality> 
<caller>: :="CALLER" SP W ( tt <address> [ • , *<name>.] " ) " 
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<called>: :="CALLEE" SP" ( "<address> [ M , ° <name> ] " ) " 
<medium> : : "MEDIUM" SP ( "VOICE" | " DATA " | "VIDEO" | "FAX" ) 
s <reference>: —"REFERENCE" SP<reference value> 

<quality>: :="QUALITY" SP<qual i ty- 1 ist> 
<options>: :="OPTION" SP ( option-list ) 
<attachments> : : =<mime data> 

10 

<callinfo-end>: : = • -- • <boundary tag> 

<address>: : =<e . 164> | <ipxtcp> | <udp> | <rtp> | <url> | . . . 

<e. 164> : : = " ( ""E164" * , "<ITU E.164 phone number 

15 specification^) 9 

<ip> : : = " ("IP""", "<Internet IP address">" 

<tcp> :=="TCP"", "<Internet IP address>" : "<number> 

20 <udp>:=="UDP"", "<Internet IP address>" : " <number> 

<rtp> : =="RT?"" , "<Internet IP address> " : "<number> 
<url> :=="URL"", "<URL address> 
<medium> : : ="VOICE" | "DATA" | "VIDEO" | "FAX" 
<quality-list> : { "<quality-value><quality-value> * " ) " 
<quality-value> : : =<grade> | <delay> | <codec-list> 
<grade> :: = "(" "GRADE" " , " ( "TOLLQUALITY" | "NEARTOLL" | 

30 » ACCEPTABLE " ) " ) " 

<delay>: : = " < " "DELAY" " , "<milliseconds>" ) " 
<codec-list> : :=" {""CODEC"", "<oodec>(", "<codec>) *■) • 

35 <codec>: :="H. 723.1" | "H.729" | " 64KPCM* | "32KPCM" | . . . 

<option-list> : : =" ( "<option-value> (" , "<option-value>) * " ) " 
<option-value> : : = 

"CHARGEBACK" | "CALLBACK" | "RINGBACK_WHEN_NOT_BUSY" | . . . 

40 <call_data_list> : =<call_data_value ( SP<call_data_value> |NULL) 

<call_data_value> ( "<key>" , "<call_data_value> " ) " 
<key>:= any data encoded in a data format acceptable by the 

45 MIME specification 

<value>:= any value encoded in a format acceptable by the MIME 
specification 

^ SP: : = (<space> | <verticaltab> | <horizontal tab>|<line f eed> | 

CRLF : = (< carriage returnxline f eed> ) (<carriage returnxline 

feed>)* 
<space> :: -space character 
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<vertical tab> : : = vertical tab character 
<horizontal tab> : : horizontal tab character 
<line feed>::=line feed character 
<carriage return> : : =carriage return character 
<name> : : =any MIME acceptable string or data 



CALL REPLY E-mail MESSAGE 

r00751 In response to a call setup message, the Called Agent 116 constructs a call reply E-mail message addressed 
to the E-mail address associated with the Calling Agent 11 4. In addition, any further communication for the hie of the 
call setup is done through call reply messages from the Calling Agent 11 4 to the Called Agent 1 1 6 or vice versa. 
[0076] The reply E-mail content is also encoded in MIME. This involves filling in the <call-reply> field of the above 
described generic call signalling E-mail message as follows: 

<call-reply : : =<mime-header><reply-body> 

<reply-body> : : =<reply-tag>" , "<boundary-specif ication>CRLF 

<reply><boundary-tag> 
<reply-tag> : : = "Con tent- type : application/x-call-reply " 
<reply> : : =<progress-indicator> | <connection> | <negotiation> 
<progress- indicator> : : = : CALL_OFFER_STATUS " SP<non-accept- 

call-state> 

<connection>: : = "CALL_OFFER__STATUS" SP" ACCEPT "CRLF 

<ref erence>CRLF<progress>CRLF 

(<medium>CRLF) 

(<caller>CRLF<callee>CRLF) 

(<quality>CRLF) * (<option>CRLF) * 

(<attachment>CRLF) * 
<non-accept-call-state> : : =" RINGING" | "FORWARDED" | "COMPLETE" 
" ( tt "DISCONNECTED" , <reason> " ) * | 
M ( * "REJECTED" , <reason>" ) " 
<negotiation> : : = "NEGOTIATION"CRLF<callinf o> 

[00771 The reply is also used as a mechanism to provide call progress. It is also used as a call accepting notification. 
If the Calling Agent wants to terminate the call before the actual call setup is completed, it can also use the reply 
message to instruct the Called Agent to terminate the call using the <non-accept-cal!-state> of "DISCONNECTED 
with a reason in the <reason> field. 

[0078] The actual contents of the reason field can be implementation dependent. It may for example be digitized 
voice (so that the audio clip can be played to the caller) or a text message to inform the caller why the call is rejected. 
However MIME allows any data type to be encoded to improve the information density of the communication. 
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Explanation ol the Fields of Call Setup E-mail Messages 

[0079] The following provides detailed information for all the components in the call setup mail messages. The syntax 
defined here follows the MIME design methodology. The data lormat specified here is designed for extensibility to 
5 handle new parameters and keywords. 
<mime-header> 

[0080] This is required by the MIME specification to indicate the beginning of the contents of the message; 
<boundary-specification> 

[0081] The boundary specification is used to delimit parts in a MIME. It specifies a unique string which is used to 
10 separate one group of data from another. The value of the boundary is defined without the (two minus sign character) 
in the specification, and at the boundary it is prefixed with two minus characters For example, boundary=eot would 
define the string 'eof as a boundary. The boundary would then appear as "--eot". 

Content-type = "application/x-cair 
[0082] This string is a mechanism to identify the E-mail message as one which is to be processed by the MCSS, 
is and to thereby distinguish it from an E-mail message serving some other purpose. This mechanism is defined in RFC 
1 341 The keyword 'application" indicates the following data is the input to an application. The string following the T 
is the class of application. It is used as a key to map to an application using a '.mime* profile. The prefix ol "x -" is used 
for any application which is not registered with the Internet Assigned Number Authority (IANA). If the MCSS provided 
by the invention is granted a designation for this class of application, the "x-call B could then be changed to something 
20 like "telephony/call". 

[0083] The information is grouped by a boundary using a boundary specification as discussed above. The information 
for the call and characteristics are included in the <call info-body> subsection of <call-info> in the MIME. 
[0084] There may be multiple call <call-info> information units in the MIME message each dealing with a respective 
connection which needs to be established. The result of this is the creation of multiple calls in a single request between 

25 two or multiple terminals. It is assumed that the multiple calls are connected from a first series of one or more terminals 
associated with the calling party to a second series of one or more terminals associated with the called party. For 
example, a caller with an ISDN terminal may request two different outgoing connections to a singled or multiple called 
terminals. Such a multiple call request may be generated through the user interface 199, or directly from the calling 
terminals if the network interfaces are modified to receive such requests. 

30 <ca II er> 

[0085] This is the component containing the caller information. The information is either an ITU E.164 address (esn 
number) or an Internet address which can be in dot numeric form (e.g. 47.34.5. 1 21 ) or symbolic form (e.g.ck.pcn.nortel. 
com). The <name> option of the caller is a feature which supports the Caller ID function. In PSTN networks, this name 
can be extracted from directories. In the IP world, this would be a name of the originator's choice. 
35 <cslled> 

[0086] This is the component for callee information. The information is either an ITU E.164 address (esn number) 
or an Internet address which can be in dot numeric form (e.g. 47.34.5.121) or symbolic lorm (e.g. ck.pcn.nortel.com). 
The address in the <called> field may also be specified by name. This is the equivalent of symbolic dialling. The function 
of the called directory number in this signalling protocol is only to permit E-mail address resolution for the called party. 
40 <reference> 

[0087] In order to identify every call setup request, a unique reference identifier is given to the call setup request. 
When the Called Agent replies, the reference is used to associate the reply with the request. 
<medium> 

[0088] This tag is used to specify the preferred call medium information. The medium of the call that can be estab- 
45 lished depends on the support ol the underlying network(s). The basic types are voice call (like the telephone services 
" offered by Bell) data call (e.g. TCP/IP call for data communication) video call (video image communication) or fax (for 
facsimile transmission). The call medium is qualified using a keyword. A few keywords are listed here and include 
VOICE, DATA, VIDEO and FAX. More keywords may be added (or additional call media. 
<quality> 

50 [0089] Quality is the parameter to express what will be the quality of service. It can be as simple as strings of tokens 
which are bilaterally agreed upon or key-value pairs in strings, e.g. (FRAME_PEFLSECOND,10) or a range of values 
(MODEM_SPEED,300,2400 t 9600,28800). This parameter is especially important to the H.323 terminals. There is op- 
tion negotiation built into the H.323 protocol family but it is an optional feature. The negotiation cannot always take 
place. Therefore, this parameter provides another alternative to perform the negotiation. If negotiation is required, the 

55 negotiation is done by sending a call request E-mail, such as described in this section, and the reply E-mail such as 
described in the next section back and forth using the same <reference> until both sides are satisfied. 
<option> 

[0090] The option parameter is used to specify call options. Some of the options can be REVERSE_CHARGE, or 
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EXECUTIVE_BARGEJN, JOIN, or other telephony features. 

rOOeir^teS^er provides any <calWata-value> arguments associated with the call setup. When the Called 
Agent processes the call, the values ot these arguments are used to setup the call as required. The follow.ng are some 

examples: 

1 . The <call-data-value> parameter can be a distinctive ringing pattern tor a voice call to be played on the remote 

2. ina call tor movie on demand, the arguments may be the sound quality, the movie title, the language of the title, 
the viewing format etc. 
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<attachment> nr „ . COi T . 

100921 Attachment is any MIME compliant contents. It can be fax, video, audio or text as defined in RFC 1521 The 
purpose of the attachment component is to enrich the contents of the call request E-mail so that as much information 
as possible can be carried in a single short message. In an outgoing call, additional caller information can be added 
to the call, e.g. a signature tile of the E-mail. If it is text, it can be played out on a H.323 terminal as a ca announcement 
rather than ringing. If it is a graphic, ft can be displayed on graphic enabled terminals, e.g. PC or NC based H.323 
rather than the default call alert user interface. To a great extent, because the attachment will be stored at the E-maJ 
server associated with the Called Agent, the user can retrieve the information by any Unified Messaging System such 
as Exchange from Microsoft or Netscape Communicator from Netscape Communications. 

r00931 One or more attachments may be included in the call setup message. There is really no Imitation , on the type 
of the attachment. Not all attachments may necessarily be processed by all implementations of the Called Agent. 

[009^ ^address can be the type presented but can also be extended. It can be any E.164 address, Internet 
protocol address, Internet protocol service address etc. 

Explanation of the Fields of Reply E-mail Messages 

[0095] Many of the fields in the reply message are the same as in the setup message, and as such, these will not 
be redefined here. The following fields are specific to the reply message: 

r00961 <re This a field contains the application class specification -application/x-call-repiy. As in the class specification 
for the setup message, if the I ANA grants a new content type for telephony, this could be changed to content-type: 
telephony/call-reply. 

[C»97] <Pr X?et o^ptrameters provides information on the progress of the call as in telephony. It helps to inform the 
caller about the current progress. 
<connection> 

[0098] This parameter indicates the acceptance of the call, and is a request to setup the call. 

<non-accept-call-state> , . 

r00991 This is an indicator of the current status of a call which has not yet been accepted and which may be rejected. 
The state may be RINGING if the callee's terminal is ringing, FORWARDED if the call is forwarded to another Called 
Agent, REJECT if the call is rejected by the callee, or DISCONNECT if the Called or Calling Agent request the termi- 
nation of this call setup request. 

[01(»r TOs^neter informs the Calling Agent orthe Called Agent to change some of the setup parameters values. 
It may be the address of the caller, the address of a callee, or the quality of the call for example. 
[0101] The following table contains an example of the contents of a call setup E-mail message: 



Line 


Description 


MIME-Version: t.O 


MIME header 


Content-type: application/ x-eall; boundary=eot 


application class 


CALLER(E164M61 37638533, "CK Wong - ) 


Caller PSTN user identifier for CK Wong 


CALLEE (E 164,61 32322486) 


Callee PSTN terminal number 


MEDIUM VOICE 


request setup a voice call 
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(continued) 



Line 


Description 


REFERENCE 0034332344 


call reference is the string "0034332344" 




enunH nualitv is toll arade with no delav e a 64KPCM 


nnnAM /■□IMPDATlJ' VA/MPKI MOT PI ICVM 
OP I ION ( HI NoDAOK_vvntr\l__!\ILJ I _DUoT ; 


a troalmont ic ron i toctorl tn inform tho rallor if thp f^allpfi hu<?\/ 
a 11 call llol 11 lo 1 cUUcolcU IU ll HUl III ll It? Ud lie I li u ic uaiict? 10 uuoy 

now 


Contenl-type: text; boundary=eom 


This call has an attachment which can be used as call ID 
information. The message may be displayed on an ADSI 
terminal for the purpose of visual call waiting, the information 
can be displayed as part of a call alert on an H.323 terminal, or 
the information can be used as an announcement of arrival for 
a conference call 


This is a call from C.K.Wong 


The message 


-com 


End of attachment boundary 


-col 


End of the message boundary 



[01 02] The above example E-mail message is from a caller having telephone number 61 36738533 to a callee having 
PSTN user identifier 6132322486 (which may or may not also be the caltee's PSTN telephone number), with VOICE 
as the prclcrred medium, 0034332344 as the setup request reference, grade - tollgrade and delay = 0 as quality 
specifications the single option RINGBACK_WHEN_NOT_BUSY, and a text attachment containing the text "This is a 
c«n Horn c K Wong". 

[0103] ihe lollowmg is an example of a call reply message: 



Line 


Description 


MIME-Version: 1.0 


MIME header 


Content -type: application/ x-call-reply; boundary=eot 


application class 


CALL_OFFER_STATUS ACCEPT 


The call is accepted 


REFERENCE 0034332344 


To inform the Calling Agent that this call is for the call which 
has the reference "0034332344" 


MEDIUM VOICE 


The Called Agent agreed to setup a voice call 


CALLER (E164 : 61 37638533) 


The caller's directory number is not changed 


CALLEE (IP.47.34.5.121) 


The callee will connect the terminal on an H.323 terminal. 
Its IP address is "47.34.5.121". 


QUALITY ((CODEC. G.729, G.711), (DELAY, 15)) 


The codec can be G.729 or G.71 1 . The terminal can handle 
a maximum network delay of 1 5 milliseconds for any voice 
packet 


-eot 


End of the message boundary 



OUTGOING CALL INTERCEPTION 



[0104] Outgoing Calls are intercepted in various manners depending upon the nature of the outgoing call. 
Outgoing Call Interception: Wireline Terminal Call 

[0105] When a wireline terminal 102 makes an outgoing call, the call is initially handled by the CO of the telco this 
being the local network interface 109 for a wireless terminal. The CO will do an address translation to find out how to 
deliver the call. For the MCSS, the address translation will result in the call being directed to the Calling Agent. The 
call request is forwarded from the relevant local network interface 109 to the Calling Agent 114 via a message through 
a communications link between the local network interface and the presentation driver 120 such as TCP/IP channel 
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I this is a normal fax call it cannot be identified as such until later. However, it the call .s done by a two stage dialling 
procedure wS Sudes a firs, number for the fax delivery and a second number for the final destination, the type of 
5 the call can be identified by the time Calling Agent is informed. 
0107^ fnsomecase^^ 

to always be done trom the local CO. The address translation can be handled via an SCP (signal control point) database 
Most of the time now, a is handled by the SCP query. The SCP can reply with where the call rs to be roulec .an iwrth 
what treatment. This is illustrated in Figure 4. In this example, a user makes an outgo.ng call from a terminal 300 wh.ch 

!he query indicates that the called address is at another Captive Office. The call setup request is routed to a System 
Signalling #7 (SS7) network 306. The SS7 network delivers the call setup request to a Local Network Interface 308 
the remote switch. The request is received by the Local Network Interface 308 of the remote swrtch and passed on 
.5 the presentation driver 1 20. The presentation driver 1 20 extracts the information in the CCS7 call setup message and 
passes the call setup request to the Calling Agent 114. 

Outgoing call Interception: Wireless Terminal Call 

[0109] A Celco uses a similar mechanism to the mechanism used by the above<lescribed telco to intercept an out- 
going call from a wireless terminal 104. The call setup request is sent to the Calling Agent. 

Outgoing Call Interception for an Internet Call 

[0110] When an H.323 terminal 106 makes an outgoing call, the outgoing call is intercepted by the local network 
interface 113 which in this case is a Gatekeeper. 

[01111 Preferably, the Calling Agent will be the Gatekeeper for all the outgoing calls. This minimizes overhead and 
duplication. Alternately a separate Gatekeeper may be used. One attribute required for an H.323 terminal ,s te IP 
address If Ihe Calling Agent does no, handle the Regis,ra,ion and Adminis,ra,ion Service for the dial-up line, the 
Gatekeeper performing Registration and Administration Services has to update the Calling Agent on the IP address. 
[01 1 2] The callee information is in an H.245 call setup request. The information can be extracted and forwarded to 

[0113] ll,n |n a specific implementation, the Calling Agent can be extended to support the H.323 call setup. 
35 CALLED AGENT MESSAGE PROCESSING 

[011 41 The Called Agent, upon receipt of a call setup E-mail message together with the Calling Agent is responsible 
or coordinating the setting up of a connection between the calling terminal and one of the ca'lee's termina^ . n sorne 
cases the CalL Agent may respond with a call reply message. After the appropriate medium has been identified 
through negotiation if necessary, the relevant native signalling components are used to setup the connection, these 
including the telephony, signalling components 181,183 and the Internet signalling components. 

How to Connect a Call from a PSTN Terminal to PSTN Terminal 

[0115] For the purpose of this example, it is assumed that a connection from a wireline terminal 102 to a wireline 

lomT' O^cethel-mS is received by the mail agent o, the called party, the Called Agent (which is an application 
associated with the mail server) will process the E-mail. The association of the Called Agent program is done by the 
application tag in the MIME. The Called Agent will extract the called terminal identifier. There are two treatments that 
so can be applied: 

1 The Called Agent will interact with the telephony signalling components 172,174 to establish a voice channel 
from the captive office associated with the mail server to the captive office where the caller's call was intercepted. 
The channel is established using the caller's phone number in the E-mail. This ensures a voice channel is ava. able 
55 Then the Called Agent will use the local CO facility (in the local network interface 109 for the wireline terminal 102) 

to oresent the call to the callee based on the information associated with the callee's current location record main- 
tained in the User Profile database. When the callee picks up the phone, the voice channel between the calter and 
See Is bridged. The setup process finishes after a reply message with C ALL.OFFER.STATUS COMPLETE ,s 
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sent to the caller. 

2. The Called Agent will inform the Calling Agent regarding the .■■ -ent location of the callee in a reply mail. The 
<reference> in the E-mail is used to relate the reply to the call To.en the Calling Agent can establish a call to the 
callee's current true location using the existing conventional telephone protocol with the telephony signalling com- 

5 ponents 172,174. Either party can finish the call setup by sending a reply message with CALL_OFFER_STATUS 

COMPLETE to the other party. 

How to connect a call from an H.323 terminaJ to a PSTN terminal 

io [0117] When the calling terminal is a PSTN terminal and the called terminal is an H.323 terminal, the call cannot go 
through directly. When the user's H.323 terminal 106 originates an outgoing call, it sends the request to the local 
network interlace 1 1 3 which is the H.323 Gatekeeper The Gatekeeper has the responsibility of performing the address 
lookup (because the address can be symbolic or alias names) which requires the address to be resolved into number 
dot notation (e.g.bmerib71. nortel.com is translated to 47.34.5121). This function is similar to the address translation 

15 in the PSTN Captive Office. 

1. The dot notation address of the callee is used as a key to query the callee's information in the address database 
186. This database maintains the mapping between the Internet address to the E-mail address of the callee's 
Called Agent. 

20 2. The caller and callee address information, call medium, and other parameters are used to construct the E-mail 

for the call setup request. 

3. The E-mail is sent to the callee's Called Agent. The Called Agent will respond with an E-mail including the 
callee's terminal identifier which will be an PSTN E.164 address. The Calling Agent makes a decision of whether 
the call is to be connected through the PSTN 1 70 or the PSN 1 78 or both based on billing and quality considerations. 

25 Once it is established that the calling terminal is an H.323 terminal and the called terminal is a PSTN terminal, 

there are existing procedures for using the PSTN telephony signalling components 172,174, the internet signalling 
components 181,183, the PSTN 170, bridge 184 and PSN 178 to make a connection. 

How to present a call from PSTN terminal to an H.323 terminal 

30 

[01 1 8] When the callee is an H.323 terminal, again the call cannot go through directly. The Called Agent will construct 
a reply to inform the Calling Agent that the destination is actually an Internet address. The Calling Agent will route the 
call through either the PSTN or PSN depending upon billing and quality considerations. Once it is established that the 
calling terminal is a PSTN terminal and the called terminal is an H.323 terminal, there are existing procedures for using 
35 the PSTN telephony signalling components 1 72, 1 74, the internet signalling components 181 ,1 83, the PSTN 1 70, bridge 
1 84 and PSN 1 78 to make a connection. 

[0119] In the two scenarios involving an H.323 terminal and a PSTN terminal, the quality option can be used to define 
the quality of service on an Internet phone call. Some of the options can be: 

40 1. codec - because an H.323 terminal can decode a small number of compressed voice data, the type of codec 

must be explicitly stated; 

2. link-speed - some H.323 terminals are linked by modem. Therefore, the communication link cannot exceed 
certain bandwidth. 

3. video-data format - since H.323 can also support ITU standard T.120 (video conference), it may be necessary 
45 to specify parameters such as compression method and the data rate. 

How to connect an H.323 terminal to an H.323 terminal 

[0120] When connecting two H.323 terminals, the reply mail will contain Internet addresses for the caller and the 
50 callee. The Internet signalling components 1 81 , 1 83 can use the information together with the quality and option infor- 
mation to establish the call. 

[0121] It should be noted that after a TCP/IP connection is established by the H.323 terminal for communication, the 
<grade> component in the E-mail can be used to specify the quality of service using the RSVP (resource reservation 
protocol) protocol. One of the problems with the RSVP protocol is that is it is receiver originated. Without the <grade> 
55 information, the callee where data is received can request the highest quality while the caller has to pay for the service. 
With the <grade> information, which can be a user feature to reduce the grade of service, the caller will not be over- 
charged. 
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CALL SETUP WALKTHROUGH 



[01221 A call setup walkthrough will now be described in detail with reference to Figure 3. 
0123 To beoin a user will originate a call from some calling terminal 200 (this being a particular one of the user s 
[ . LT«Ss 1M 06 shown in Figure 2) resulting in a call setup request being generated. The call setup 
^^^2^ ^ i P- ed ^ network 'nterface (not shown) and 

S .Sa^work interface where h wi.l be intercepted, converted to a generic ^.^^SS^ S 
u N La naeM H tnthP raiiino Aoent In POTS the call is intercepted by the captive office. In GSM/PCS, the can 

rSeZ^^ 

0 24 Next the Calling Agent 114 examines the called user identifer contained m the setup reques and looks up a 
cor^pondtg destination E mail address in the address database (not shown). The Calling Agent w,l I then gene ate 
an outodng -mail message to the address as described above. The E-mail message ,s then delivered by he calhng 
Tnd man serveM80 to the catted end mail server 182 over the Internet. This E-mail should always be sen usmg the 
htah^t orioritv The mail servers 180,182 should observe this priority and deliver the message as quickly as possible. 
pTZZ7eV^!Z^ by ihe called end mail server 182 need to be processed quickly, almost ,n real time, 

ro n i d 251 b As a Sn S^^SS^^C-W Agent 116, the Called Agent will examine the contents of the 
E-ma message ^ The i'originators information will be extracted from the message. The Called Agent w,l .dentrfy 
th Tcurr'n telna, associated wrth the called parly by looking up the relevant record * t he user p^- 
k D ooo^iiaiion siaae fnot shown in Figure 3) during which call parameters are negotiated and settled. The Callea 
Aaen^.HhTp,ese 9 n. the ca " the current temvJusing the native call setup, .f the user is now associated with a 
~H 3^1 the cShs Sered to the celco. If the user is now associated with the PSTN, the call is delivered o the 
e, o If the usen owtscled with an H.323 terminal, the Called Agent will use H.323 to establish the call. The 
S ed Agen^i determine whether the preferred medium identified in the message matchesthat of the current terminal 
ll lTtZT^rna^, then a converse is attempted. ., no such conversion is possible the call w,H be , rejected 
wS an appropriate reason. The rejection may be returned via a mail message with video text vo.ce message^ and 
wrtn an app P t the attachme nts to the destination terminal as 

ItSSS wht' S exaZ, may dispfcy iph.s, video clips, audc clips, or 

The Called Agent may a.sobe configured to perform a persona, agent function which for example may display incoming 

calls and respond to screened calls accordingly. 

Supplementary Services 

[0126] Preferably, conventional telephony services can be implemented or supported by mis ^ 
Scture of the network using this protocol » lundamentally indifferent from the exjst.ng ™&<™™ 
nSwork l^inv of the services can be preserved. However, some of the call setup and billing support can be imple- 
ment S Tne toZhg section's outline how to implement these using the capability offered by this invention. 

CLASS Service 

10127] CLASS is Common Local Area Signalling Service. It provides a number of services ranging Irom _ display 
messaqe to different ringing tone. These capabilities are readily available using the attachment comment hv the 
MIME message as described previous.y. The advantage of the signalling protocol is that v.deo and graphics can also 
be added. 

Caller ID 

r0128l CallerlDreferstothecaller-sdireW 

o tne name The calling directory number is part of the call setup in PSTN. The character string relies on the local 
it *.oZ daiateS ^ , current existing protocol cannot include the character string in the call setup signalling and 
^cSSZ^Zm. the name in long distance calls. However, the invention provides the opportunity to 
fncllde this information which makes the Caller ID name service extendable across long distance areas. 

Call Forward 

roi29] Call forward means the user of a particular directory number would like to receive future incoming calls at a 
different location. This can be easily done by changing the current terminal associated wrth the user. 
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Simple Call Management 

[01 30] The Agent based architecture provides an additional business opportunity tor the telephone networks which 
may not otherwise be easily extended to support multi-media. The following describes three typical call scenarios which 
5 provide new capability tor users. Collectively, ail these scenarios can be treated the same way. 

Destination Busy 

[01 31] When the destination is busy, the typical treatment is to let the caller decide to retry later. Addition opportunity 
io and implementation may be made available to charge the user on a per usage basis to ring back. This can be an option 
specified by the caller in the user profile. 

Call Not Answered 

is [01 3" T When the callee is not around the terminal, the call can be offered, but no body is going to answer it. 
Call Rejection 

[01 33] Because of the attachment, a callee will know who is calling. The call can be rejected from an H.323 terminal 
20 . or an ADSI terminal with a visual call waiting feature. 

Treatment 

[01 34] When one of the above scenarios happens, the user can be presented with the following options: 

25 

1. leave a voice message for the callee in which case the message will be digitized by the Calling Agent. The 
digitized message will be sent and attached to a call setup reply message as an attachment. 

2. send a fax to the caller which can be retrieved by the callee later. The fax will be stored by the Calling Agent 
and sent to the Called Agent which will attach the fax to a call setup reply message as an attachment 

30 

Unified Messaging Support (UMS) 

[01 35] This invention allows the telephony services to evolve around a UMS. Users can use the UMS to get the caller 
id record, voice message, fax message or event text message. 

35 

Call Transfer 

[01 36] If the call transfer is within the same network, existing telephony protocols (except Internet terminal) have a 
well defined procedure to handle the transfer. These are replicated here. 
^0 [01 37] This invention does not provide a new support to transfer calls between different networks or media. However, 
because the Calling Agent and Called Agent can be extended to monitor the life cycle of a call, it can provide support 
and coordinate the transfer calls between different networks and media using the following procedures. 

Transfer Between Different Network Types 

45 

[0138] 

1 "^e user will signal the Agent (Calling or Called Agent) to perform the call transfer either through in-band (flash 
a; jial) or out -of -band signalling from another terminal. 
so 2. -ie Agent will request the local network interface to disconnect the voice channel connected to terminal. 

3. "he Agent will command the interface to the telephony network. 

4. Another call is established to the new destination under the control of the Agent through a gateway. 

5. After the new call to the new destination is established, the voice channel from the network is routed to the new 
destination. 

55 
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Transfer Between Different Media Types 



[0139] 



1. The user will signal the Agent (Calling or Called Agent) to perform the call transfer either through in-band (flash 
and dial) or out-of-band signalling from another terminal. 

2 The Agent will request the local network interface to disconnect the voice channel connected to terminal. 

3 The Agent will command the interlace to the telephony network to suspend the call. 

A. Another call is established to the new destination under the control of the Agent through a gateway. This gateway 
will be responsible for the conversion ol the medium type, e.g. codec. 

5. After the new call to new destination is established, the voice channel Irom the network is routed to the new 
destination. 

Detailed Description of Call Transfer Interface 
From PSTN Network 

10140] The first step in switching to another terminal is to suspend the current call and signal the switch for the 
transfer. The following scenarios describe the common procedure used to suspend the current call and s.gnal the 
switch lor the transferring. 

1 From an analog terminal, user will flash and perform a call forward operation. 

2. From a digital set, e.g. ISDN, the terminal will send a supplemental service message to request the terminal to 
be forwarded. 

101 411 Once the call is suspended, the user can signal a request to be connected to the Call Agent which can handle 
the call transfer. One way to request to be connected to the Call Agent is to use the "nn" convention. For example, 
the code "11" can be assigned for this function. ... 
101421 After the call is suspended, Ihe user can press "11" and log on to the Calling Agent with appropriate identi- 
fication and authentication. From the data where the input is coming from, the Calling Agent can identify the suspended 
call. Then the user can instruct how the call will be forwarded. There are two treatments to his request. 

1 The feature can limit the transfer among the terminals subscribed by the user. It does not allow the user forward 
to any other terminal. However, if the user wants to forward to any other terminal, there may be an existing call 
forward supplementary feature to support it. 

2 The call forward can be to the terminals for which the user subscribed to the service and any other terminals. 
In this case the interaction can be designed to prompt the user to determine which kind of transfer will be required 
For the subscribed terminal, the user can select from a list presented by the Calling Agent. For any other termmal. 
the user enters the destination directory number. The Calling Agent will use the existing supplementary services 
to perform the call transfer. There are two treatments to support this service. In the first, the customer must sub- 
scribe to the supplementary service before it can use this feature, and in the second, the telco/celco can charge 
the user on per usage basis. 

[0143] If the destination is a PSTN directory number (DN), the switch can use existing software to perform the call 
forwarding. 

[0144] It the destination is an H.323 terminal, the call is routed through Voice Over IP Gateway. 
From H.323 Terminal 

[0145] If the destination is another H.323 terminal, it can use the supplementary seivices to be defined for the H.323 
to perform the call transfer. 

[0146] If the destination is a PSTN terminal, the call can be routed to an Internet Terminal Gateway. 
Alternate Access to the Calling Agent 

[0147] When a customer is away from the set of registered terminals, he can access the Calling Agent using different 
vehicles This section describes several possible implementations. 

[01 48] All these procedures incur the authentication of the user. The charge can be made to the user s account rather 
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that the owner of the terminal. 
Access from POTS or Equivalent 

5 [0149] The lollowing procedure can be used from a terminal which has a telephony key pad and no other display 
device such as a POTS terminal. 

1 Dialing a special designated terminal number which will connect the voice channel to a I VR (interactive voice 
response) system which is a front end of the Calling Agent. This I VR system will collect the information and forward 
w the information to the Calling Agent. 

2. Log on using the user's account name and password. 

3. The IVR system prompts the user for the destination terminal number. 

4. If there is no called address handler go to step 7. 

5. If called address has a handler, the handler will be activated and connects to the voice channel. 
75 6. When the called address's handler has finished, go to step 7. 

7. Calling Agent constructs the MIME message and uses MCSS to establish the call. 

Access from ADSI Terminal or Equivalent 

20 [0150] The lollowing procedure can be used to establish a call from an ADSI (analog display services interface) 
terminal which has a display and programmable buttons. 

1 . Dial a special number on an ADSI server which has support for MCSS. 

2. The user performs the log on using the user's account name and password. 

25 3. The ADSI server will download an ADSI script to prompt the user with additional destination information such as: 

callee address 

medium (e.g. voice or fax) 

quality (using PSTN long distance or through Internet Gateway) 

30 

4. If there is a callee address handler, an ADSI script can be downloaded to the terminal to acquire more information. 

5. When the data input is completed, the Calling Agent receives all the information and proceeds with the call setup. 

Access from an H.323 Terminal with Web Browser Support 

35 

[0151] The following procedure can be used to establish a call from an H.323 Terminal with Web Browser support. 

1 . Access a Universal Resource Locator of the Calling Agent 

2. Perform log on using the user name and password with encryption enabled and a public key used. 
40 3. The Calling Agent's Web interface will download a form to acquire the callee address information. 

4. If there is a callee address handler, the callee address handler will send another form to collect more data. 

5. After all information is collected, the Called Agent performs an Internet terminal call setup on behalf of the caller. 
The call will be a callback type which means the destination call originate the H.323 call. 

45 Create Attachment for the Call 

[0152] The call setup E-mail has the capability to include fax, video clip and voice clip. The following description 
outlines how these contents can be created and included in the MIME message. 

50 Attach Voice Clip to a PSTN Call 

[0153] The following procedure can be used to create a call with a voice clip included. 

1 . User calls a special number to connect to the Calling Agent. 
55 2. The user will use the password to authenticate his/her identity. 

3. The user records a voice clip. 

4. The user instructs the Calling Agent to call a destination. 
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Attach Fax to a PSTN Call 

[01 54] The following procedure can be used to attach a faxed document to a PSTN call. 

1 User calls a special number to connect to the Calling Agent. 

2 The user informs the Calling Agent to prepare a call with a Fax attachment. 

3 The Caliinq Aqent gives a terminal number and password to the user. 

4. Sinai number is a fax reception server. The password allows an assoc.at.on of the fax uploaded and the 
current call request. 

5. The user dials the terminal number to prepare the fax. 

6. The fax server will ask the user to enter the password. 

7 if acceDted the fax protocol for transmission is carried out. 

8. Once me 7a* ■ tLJLion is complete, the Calling Agent can construct the MIME message to estabhsh the call 
or just deliver the Fax. 

101551 inanaltemativetothisprocedureausercan^^ 

Lnd fix the doc ument. The fax server will provde a fax identified whfch can be used to .nstruct the Cd.,ng Agent 
TextTacUhe fax from the fax server to construct the MIME message. With this technrque only one term,nal call ,s 
active at a aiven time so the user can have a single line for lax and voice call. 

f 561 VSL functions can be executed on a PC which connects to the Calling Agent « a d,al up l,ne or Ethernet. 
In this case, the file can be sent to an FTP (file transfer protocol) server rather than a Fax server. 

Access to MIME Messages Through UMS 

ro1S7l The call setup messages are delivered as MIME message. They can be stored on a Unified Messaging Sys- 
EuSM) message server such as Microsoft's Exchange, Sun's Solst.e or Lucent's Intuity The .nterface to these 
message will provide access to various components constituting the call setup message. 

Caller Information 

[0158] The caller's call setup requests are stored as E-mails or messages on the Unified Messaging System. These 
E-mail are the equivalent of the caller identification records on a Caller ID device. 

Attachment 

[0159] The UMS interface can retrieve and present the attachment (such as the text message, voice message, fax 
or even video) to the user. 

Signal Flow Examples 

[0160] Various signal flow examples will now be described with reference to Figures 6-1 2. In these figures, the num- 

^,X^^'5SSSl«r «or a basic vo*e ca, In step 1 , the Calling Agent constructs the call setup 
l Z st m ssage andTends it to the mail server to be sent to the Called Agent. In step 2. the mail sewer sends the 
pTaTto the PSN network. In step 3. the E-mail arrives at the Called Agent's ma.l server. In step 4. the Ma.l Server 

(us inq the Z protocol) to retrieve the E-mail. In step 6. the E-mail is delivered to the Called Agent. In step 7 he 
Ca .2 ^constructs a reply and sends this to the mail server. In step 8, the mail server sends the E-ma.l o the 
PSNlnTp 9 the E-mail arnves at the Calling Agent's mail server. In step 10, the mail server sends a not,f,cat,on to 
the CaLo AgenUn step 11, the Calling Agent requests the mail server to deliver the E-mail. In step 12. the ma.P server 
deliveSe E-mail to the Calling Agent and the Calling Agent uses the information ,n the repfy message to estabhsh 



m!!a Fiaure 7 shows the message flow for a voice call with no answer. In step 1 . the Calling Agent constructs the 
2 1 s ,u P equel, message and sends it to the mail server to be sent to the Called Agent. In step 2. the ma,l server 
Jnds the E-mail to the pIn network. In step 3. the E-mail arrives at the Called Agent's ma,, server. In step 4 the Mart 
^r^tffiesThe mail client which is the Called Agent of the arrival of the E-mail. In step S^the Called Agent present 
fhe callTo the terminal through the presentation driver. In step 6. the user creates an attachment. The attachment can 
be vo^es^e. tax. or graphics The Calling Agent creates a reply message and passes t to the ma,, server. In 
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step 7, the mail server sends the E-mail. In step 8, the mail is delivered to the Called Agent mail server. In step 9, the 
mail server sends a message arrival notification to the Called Agent will store the reply message with attachment to 
be retrieved by the user later. 

[0163] Figure 8 shows call forwarding to another MCSS user. In step 1 . the Calling Agent constructs the call setup 
s request message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail server sends the 
E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server In step 4, the mail server 
notifies the mail client which is the Called Agent 1 of the arrival of the E-mail. In step 5, the Called Agent 1 requests 
the mail server to deliver the E-mail. In step 6, by examining the user profile, the Called Agent 1 finds out that the call 
is to be forwarded to another user handled by Called Agent 2. In step 7, the Called Agent 1 instructs the mail server 
10 to forward the E-mail to the Called Agent 2. In step 8, the mail server delivers a message arrival notification to Called 
Agent 2. In step 9, the Called Agent 2 requests the mail server to deliver the mail. In step 10, the call setup request 
message is sent to the Called Agent 2. The Called Agent 2 can either initiate negotiation or accept the call. 
[0164] Figure 9 shows the voice message service/personal agent service. In step 1 , the Calling Agent constructs 
the call setup request message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail server 
is sends the E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server. In step 4, the mail 
server notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5, after consulting the user 
profile, the Called Agent constructs a reply message which will connect the call to a voice message service server or 
a personal agent service server. The redirection in done by specifying the called address of where the call can be 
completed by the Calling Party. The reply message is passed to the mail server. In step 6, the mail server sends this 
20 to the network. In slep 7, ihe reply mail is delivered to the mail server. In step 8, the mail server sends a message 
arrival notification to the Calling Agent. In step 9, the Calling Agent requests the mail server to deliver the message. 
In step 10, the mail server delivers the reply message to the Calling Agent. The Called Agent examines the contents 
of the reply and determines the call is accepted, and instructs the signalling components to complete the call without 
answering. The call is actually delivered to a voice message service or personal agent service. 
25 [0165] Figure 10 shows the follow me" scenario. The user is now at a terminal which is not controlled by the Called 
Agent for the user. He/She first connects to the Call Agent of the user. He/She instructs the Call Agent to change the 
user profile to deliver calls to a specific terminal by giving its address. The Call Agent for the user collects the information 
and updates the user profile to be used by the Called Agent. In step 1. the Calling Agent constructs the call setup 
request message and sends it to the mail server to be sent to the Called Agent. In step 2, the mail server sends the 
30 E-mail to the PSN network. In step 3, the E-mail arrives at the Called Agent's mail server. In step 4, the Mail Server 
notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5, the Called Agent requests the 
mail server to deliver the E-mail. In step 6, by examining the user profile, the Called Agent finds our that the call is 
forwarded to Terminal A. In step 7, the Called Agent constructs a reply message which accepts the call with Terminal 
A's address as the Callee Address. The message is passed to the mail server. In step 8, the mail server send the mail 
35 to the PSN. In step 9, the PSN delivers the mail server. In step 10 the mail server sends a message arrival notification 
to the Calling Agent. In step 11, the Calling Agent requests the mail server to deliver the message. In step 12, the mail 
server delivers the E-mail to the Calling Agent. The Calling Agent extracts the message and finds out it is an accept 
reply message. It instructs the telephony signalling components to complete the call using the address in the reply 
message. 

40 [0166] Figure 11 , shows a multi-media message with attachment. The user connects to the Call Agent to provide the 
contents of a multi-media message. The user can record a voice message. He/She can fax the document to the Call 
Agent. He/She can upload an electronic file using File Transfer Protocol to the Call Agent. The Call Agent provides an 
identity to every artifact stored. The user connects to Calling Agent and instruct the Calling Agent to establish an 
outgoing call using the artifacts stored at the Call Agent. The Calling Agent asks the Call Agent to provide the artifacts 

45 using the id provided by the user. The Call Agent sends the electronic copy of the artifact to the Calling Agent. In step 
1 , the Calling Agent constructs the call setup request message with all the artifacts as attachments and sends it to the 
mail server to be sent to the Called Agent. In step 2, the mail server sends the E-mail to the PSN network. In step 3, 
the E-mail arrives at the Called Agent's mail server. In slep 4, the Mail Server notifies the mail client which is the Called 
Agent of the arrival of the E-mail. In step 5, the Called Agent issues a command (using the mail protocol) to retrieve 

so the E-mail. In step 6. the E-mail is delivered to the Called Agent. In step 7, the Called Agent extracts the attachments 
and presents them to the terminal selectively according to the terminal capability described in the terminal profile. Later 
it constructs a reply and sends this to the mail server. In step 8, the mail server sends the E-mail to the PSN. In step 
9, the E-mail arrives at the Calling Agent's mail server. In step 10, the mail server sends a notification to the Calling 
Agent. In step 11 s the Calling Agent requests the mail server to deliver the E-mail. In step 1 2, the mail server delivers 

55 the E-mail to the Calling Agent. The Calling Agent extracts the contents in the reply message to terminate the call with 
information in the reply or initiate negotiation or initiate a call setup using the signalling components. 
[0167] Figure 12 shows a multiple multi-media call setup. The user connects to the Calling Agent and requests a 
multiple-call setup request. The Calling Agent redirects the user's call to an I VR system to collect the multiple call setup 
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reouest When the data collection is complete, the IVR system passes the multiple call setup request the Calling Agent 
Instep 1 the Calling Agent constructs the call setup request message with multiple call requests. In step 2 the mail 
se^er sends the E-mail to the PSN network. In step 3. the E-mail arnves a. the Called Agent's ma.l serve, In. step 4 
me Man Server notifies the mail client which is the Called Agent of the arrival of the E-mail. In step 5. the Ca ted Agent 
ssues a command (using the mail protocol) to retrieve the E-mail. In step 6, the E-mail is defivered to the Called Agent, 
n step l Z Called Agent extracts the call requests from the message and constructs a reply to accept all the calls, 
in step 8 the mail server sends the E-mail to the PSN. In step 9, the E-mail arrives at the Calling Agent's ma server 
,n step 10 the mail server sends a notification to the Calling Agent. In step 11 , the Calling Agent requests the ma.l 
serverto deliver the E-mail. In step 12 the mail server delivers the E-mail to the Calling Agent. The Calhng Agent sets 
ud calls usinq the address information in Ihe message. 

[0168] An attachment may be presented to the terminal without completing the call if the called party chooses this 

mi 691 Numerous modifications and variations of the present invention are possible in light of the above teachings. 
It is therefore to be understood that within the scope of the appended claims, the invention may be practised otherw.se 
than as specifically described herein. .» am , liua i„ 
,01701 in the illustrated embodiments, the Called Agent and the Calling Agent are network components. Alternately, 
these can be migrated to terminals. This can be realized by a network-wide distributed implementation of these com- 

SoTtT in summary, the invention provides a system and method for performing call signalling for multimedia call 
setups A user equipped with calling terminals ol various types may initiate a call from any ol these terminals, and the 
call is intercepted and handled by the system. A calling agent looks up an E-mail address for the called party, and 
sends a setup request E-mail toa called agent associated with the called party. The called agenl determines the current 
terminal that the callee is using, and together with the calling agent a call medium and other parameters are established. 
Then a connection is made between a calling terminal and the current terminal. This provides a generic signalling 
system lor a callee using a wireline terminal, wireless terminal, or H.323 terminal to be connected to a called terminal 
also being any one of these or other types. 



Claims 

1 A multimedia call signalling end system comprising a calling agent for connection to a network for coordinating 
' the establishment of a connection between a calling terminal served by the calling agent and another terminal, the 
calling agent comprising: 

a) means for receiving a call setup request including a user identifier; 

b) means for looking up an electronic network address corresponding with the user identifier; 

c) means for generating a call setup electronic message with said electronic network address and sending it 

to said address; and . 

d) first means lor coordinating the establishment of an outgoing connection between a calling terminal and 

the another terminal. 

2. A system as claimed in claim 1 . wherein said means for receiving a call setup request receives the request from 
the calling terminal. 

3. A system as claimed in claim 1 or claim 2, further comprising a user interlace for receiving the call setup request. 

4 A system as claimed in any one of claims 1 to 3, turther comprising a terminal profile database containing a terminal 
' profile lor each ol a user's terminals which are served by the system including a terminal type lor each terminal, 
wherein the calling terminal is one of the terminals. 

5. A system as claimed in any preceding claim, wherein a canned terminal profile is used when the calling terminal 
is not included in said terminal profile database. 

6. A system as claimed in any preceding claim, further comprising a user profile database containing an identification 
of which of said user's terminals a user is currently using. 

7. A system as claimed in any preceding claim, further comprising an address translation database containing a 
mapping Irom said user identifier to said E-mail address. 
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8. A system as claimed in any preceding claim, wherein said outgoing connection is established over a packet 
switched network or a public switched telephone network depending upon billing and quality considerations, in 
cooperation with signalling components with the selected network. 

5 9. A system as claimed in any preceding claim, further comprising local network interfaces between the calling agent 
and each of the user's calling terminals for supporting calling terminals of various types including cellular terminals, 
wireline terminals, and H.323 terminals. 

10. A system as claimed in any preceding claim, further comprising a calling presentation layer between the calling 
io agent and the calling terminal for performing a receive type conversion on signals received through the outgoing 

connection from said another terminal from the transmission format used over the outgoing connection to a calling 
terminal format required by the calling terminal if the calling terminal format is different from the transmission format, 
and for performing a transmit type conversion on signals to be sent through the outgoing connection from the 
calling terminal format to the transmission lormat if the calling terminal format is different from the transmission 
is format. 

11. A system as claimed in any preceding claim, lurther comprising a called agent for handling incoming call setup 
electronic messages, the called agent comprising: 

20 a) means for receiving an incoming call setup electronic messages, the incoming call setup electronic message 

including a user identifier; 

b) means for looking up a current terminal identifier which identifies a current terminal associated with the user 
identifier; and 

c) second means for coordinating the establishment of an incoming connection between the current terminal 
25 and another terminal which originated the call setup. 

12. A system as claimed in any preceding claim, wherein the network comprises a packet switching network (PSN) 
and a public switched telephone network (PSTN), and wherein said first means for coordinating the establishment 
of an outgoing connection participates in the selection of either the PSN or the PSTN for the outgoing connection, 

30 and then cooperates with a native signalling component for the selected network to make the outgoing connection, 

and wherein said second means for coordinating the establishment of an incoming connection participates in the 
selection of either the PSN or the PSTN for the incoming connection and then cooperates with a native signalling 
component for the selected network to make the incoming connection. 

35 13. A system as claimed in any preceding claim, wherein said first and second means for coordinating the establish- 
ment of an outgoing and incoming connection respectively participate in a determination of a transmission format 
each said connection, the system further comprising. 

a called presentation layer between the called agent and the current terminal for performing a receive type 
conversion on signals received through the incoming connection from a transmission format used over the incoming 

40 connection to a current terminal format required by the current terminal if the current terminal format is different 

from the transmission format, and for performing a transmit type conversion on signals to be sent through the 
incoming connection from the current terminal format to the transmissbn format if the current terminal format is 
different from the transmission format.. 

45 14. A system as claimed in any preceding claim, further comprising an interface to a Unified Messaging System or 
personal agent service. 
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